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We study driven systems with possible population inversion and we give optimal 
bounds on the relative occupations in terms of released heat. A precise meaning to 
Landauer's blowtorch theorem (1975) is obtained stating that nonequilibrium occu- 
pations are essentially modified by kinetic effects. Towards very low temperatures we 



£S) . apply a Freidlin-Wentzel type analysis for continuous time Markov jump processes. 



It leads to a definition of dominant states in terms of both heat and escape rates. 



STOCHASTIC NETWORK 



<D 

t> 

The construction of nonequilibrium statistical mechanics requires to develop general 
concepts and mathematical techniques for dealing with driven systems. Useful inspiration 
can already be obtained from the simplest systems undergoing a Markov evolution. A 
£> " well-known example is Schnakenberg's network theory where affinities are defined from the 

<n: n n 

cycles of the graph associated with a Markov jump process [1|, |2[. A much more recent 



example maps nonequilibrium fluxes onto a Markov process on a cycle space [3j. Still 

c-^ ■ 

O 1 far from treating phase transitions, we feel that a nonequilibrium theory must include 

extensions of the Gibbs formalism where besides heat and energy, also other kinetic aspects 
are crucial for the evaluation of state occupations. The present paper provides rigorous 
information on that question, first by giving new heat bounds on the stationary occupations 
in Section [III and continuing in Section IIHI by mathematically stating in the framework of 



a. 



We 



Markov jump processes an insight of Landauer, known as the blowtorch theorem 
end in Section [IV] with a low temperature analysis to develop the notion of dominant states. 
There we meet most prominently the two contributions, one referring to the "life-time" of 
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states and the other to their "accessibility", that determine the (asymptotic) stationary 
occupations outside equilibrium. The main method is to represent the Markov jump process 
as a stochastic network and to apply a flow-graph or Kirchhoff formula for the stationary 
distribution. This formula is well-known and was also used in the evaluation of stochastic 



stability in spatial games, see e.g. 



We consider a graph Q with nodes x,y, . . . 6 K that represent physical states on some 
reduced level of description such as the collection of particle positions or spins or chemo- 
mechanical configurations of molecules. Between any two states are associated the heat 
q(x,y) = —q(y,x) G R and the activation ip(x,y) = ip(y,x) > 0, where the words refer to 
their physical meaning in an Arrhenius-formula for transition rates k(x, y). More specifically 
we introduce the Markov jump process with rates 



k(x,y) := ip(x,y) exp ^q(x,y) 



(1) 



where /3 > is called the inverse temperature of the environment. In that way, the process 
satisfies the local detailed balance condition, js, 9] 

k(x,y) 



log 



k{y,x) 



(2) 



with 0q(x, y) the entropy flux under the jump x — > y. On the other hand, the escape rates 
:= Yliy k(, x >y) depend also on the prefactors i[)(x,y). The edges of Q are made by the 
pairs (x, y) over which ip(x, y) > 0. To these values we also refer as determining the kinetics 
of the process. Physically that also depends on the temperature, i[)(x,y) = i/;(x,y;fl), but 
we will postpone to make that dependence more explicit till Section IIVI 



For mathematical simplicity we assume that the state space K is finite and that the 
Markov process defined above is irreducible (and hence also time-translation ergodic in 
its stationary regime). The backward generator is (Lg)(x) := J2 y k( x iy)l9(y) ~ 9i. x )]-i 
and the unique stationary probability distribution p > on K is characterized by 
^}2i X p{x){Lg){x) = for all functions g. That is equivalent to the stationary Master 
equation. ^2 y [p(x)k(x, y) — p(y)k(y,x)} = for all x. We also refer to p(x) as the stationary 
occupations and we are interested to understand the behavior of these occupations in terms 
of the heat {q(x, y)}, activation {ip(x,y)} and inverse temperature (3. 
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A useful representation of the stationary distribution is in terms of the Kirchhoff formula, 

p{x) = ^WG)' w W'=Y,<T m ) (3) 

y "f 
in which the last sum runs over all spanning trees in the graph Q and T x denotes the in-tree 

to x defined for any tree T and state x by orienting every edge in T towards x; its weight 

w(%) is 



{%) := J] k{b) (4) 



w v 



i.e., the product of transition rates k(b) = k(y,z) over all oriented edges b = (y,z) in the 
in-tree T x . (To simplify notation, we identify the graph with the set of its edges. We refer 
to [?| for the necessary elements of graph theory.) 



II. HEAT BOUNDS ON THE STATIONARY OCCUPATIONS 

For any oriented path T> along the edges of the graph Q we write q{T>) for the total 
dissipated heat along V, i.e., q(T>) := ^2 b q(b). For any spanning tree T we also define % y 
as the (unique) oriented path from x to y along the edges of T. 

Proposition II. 1. For all states x,y G K, under the stationary distribution p, 



p(y) T lT w ( r y) 

where the sums are over all spanning trees in the graph Q . 



(5) 



Proof. For any tree T and states x, y we decompose the corresponding in-trees (as sets of 
oriented edges) as % = T yx U (T x \ T yx ) and T y = T xy U (T y \ T xy ), respectively. Observing 
that (i) % y = —T yx (the orientation of all edges inverted) and (ii) T x \ T yx = T y \ T xy (the 
orientation of all edges kept unchanged), the local detailed balance ([2]) yields 

w(Ty) K } 

This being applied in ([3])-fll]) proves □ 



The representation ([5]) immediately implies 
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Corollary II. 2. The relative stationary occupations satisfy 

mmq(T>) < — log ^ r < ma,xq(V) (7) 

y^tx P P\V) y^,x 

•with the minimum and maximum taken over all oriented paths (i.e., self-avoiding walks ) from 
y to x in Q . When either one of the two inequalities is an equality, then both inequalities 
become equalities and the minimum coincides with the maximum. 

In words, the relative occupations p(x)/p(y) can be estimated via the heat along the 
most- and the least- dissipative paths connecting x and y. Note that in the case of global 
detailed balance q(x,y) = E(x) — E(y) in ([TJ) — (J2D for some energy function E(x), and the 
heat q(T>) = E(x) — E(y) only depends on the initial and final configurations x,y of the 
path V. Then, the lower and upper bounds coincide for all pairs x, y and ((7|) reproduces the 
Boltzmann equilibrium statistics for p. 



III. BLOWTORCH THEOREM 



The heat function q(x, y) provides a partial ordering in the following sense. We write 
x y y (respectively x >z y) whenever q(T>) > (respectively q(T>) > 0) along all oriented 
paths T> from y to x\ one readily checks the transitivity condition for partial order. By 
Corollary III.2| x >z y implies p(x) > p(y). Moreover, if x y y then p(y)/p(x) converges 
to zero in the zero-temperature limit — > +oo, exponentially with rate bounded from 
below through the least-dissipation path from y to x. Sometimes (typically in regimes not 
very far from equilibrium), this can be enough in order to determine the asymptotically 
most populated configuration(s) analogous to equilibrium "ground states", as well as to get 
bounds on the leading excitations. However, in general, considerations based only on heat 
may become insufficient, and the next section describes exactly what information is needed. 

Both relations x >z y and y >z x are obeyed simultaneously only if q(T>) = for all paths 
connecting x and y, in which case p(x) = p(y). On the other hand, any two configurations x 
and y are incomparable in the sense that neither x >z y nor x ^ y, if and only if there exist 
two oriented paths T>\^ from x to y such that q(T>i) < < q(T> 2 ). In this case it cannot be 
decided which of the occupations p(x), p(y) is larger on the basis of the heat functions q(x, y) 
only and the symmetric components of the transition rates become essential. In fact, any 
chosen path from x to y can be arbitrarily enhanced (or all the remaining ones arbitrarily 
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suppressed) by suitably adjusting these symmetric parts, cf. (jSD, indicating that either of the 
two inequalities between p(x) and p(y) can indeed be attained. This is the essence of the so 



called "blowtorch theorem," heuristically introduced by Landauer J4] to argue that entropy 
production (variational) principles cannot have a general validity. We can now formalize 
that as 

Proposition III.l (Blowtorch theorem). Whenever for a pair of states x* and y* neither 
x* y y* nor y* y x* holds, then without changing the heat function {q(x, y)}, we can always 
make either p(x*) > p(y*) or p(x*) < p(y*) by changing the kinetics {ip(x,y)}. 

Proof. Assuming the hypothesis is true, there exists a path T> from state y* to x* such that 
q(T>) > 0. Let T be a spanning tree such that T y * x * = D and define ip(b) = 1 for all b G T 
and ip(b) = 5 > otherwise. Then for S small enough the tree T provides a dominant 
contribution to the tree-sums in fl5]) such that p(x*)/p(y*) > e^ q ^' 2 > 1. The existence of 
if) such that p(x*)/p(y*) < 1 follows by the same argument. □ 

Example III. 2. Let us consider a random walk on the ring {1, 2, . . . , N} where we identify 
N + 1 = 1. The transition rates are taken 

k(x, x + 1) = p x e^ qx , k(x + 1, x) = p x e~ 2*% x E Z N 

for p x > and total heat Q = J2x=i along the ring. Global detailed balance implies 
Q = 0; here we assume Q > 0. Between any x, y G I^n there is a positively (clockwise) and a 
negatively (anti-clockwise) oriented path, V + (x, y) respectively T>~(x, y), with corresponding 
heat along these paths satisfying 

q{V + {x, y)) = -q(V-(y, x)), q{V + {x, y)) + q{V + {y, x)) = Q 

In particular, q{V + (x,x + 1)) = q x and q(V~(x,x + 1)) = q x — Q. Hence, the sites x and 
x + 1 can be heat-ordered (y) provided both heat quanta q(V ± (x, x + 1)) have the same sign, 
i.e. for q x (0,Q). If this condition is verified for all sites x then the heat-order becomes 
complete, extending the detailed balance case (Q = 0) where the completeness is obvious. 
Remark that whenever q x > for all sites x then the heat-order can only be partial since 
our complete-order condition is then in contradiction with the constraint ^ x q x = Q > 0. 
Furthermore, in a diffusion regime where q x = 0(1/N) while keeping Q = 0(1), the heat- 
order only applies for the neighboring sites (x, x + 1) such that q x < 0. 
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To illustrate the blowtorch theorem, Proposition IIH. 1| we take the specific case N = 3. 
The stationary occupations follow (J5J), 

p(l) _ e- (3qi p l p 2 e^ qi - q2) + e^ q2+q3 ^> p 2 p 3 e-^ q2+g ^ + e"^ 1 p x p 3 iqi+qs) 

p{2) pi p2e § (91-92) +p2p3e -§ (92+93) +pip3e |(9l +93) 

Non-ambiguous case. It is immediate that when 52 + 93 = —91 (detailed balance), then 
p(l) = e ~P qi p(2). But we also see that if q{V + {l,2)) = q x > and q(V~(l,2)) = -g 3 -<?2 > 
0, then still p(l) < p(2), independent of the ^1,2,3- Here the heat released along both paths 
from 1 to 2 is always nonnegative and that is why the occupation of 1 cannot exceed the 
occupation of 2. 

Ambiguous case. Take now both q\ > and q 2 + 93 > as well. Then, by taking p\ very 
small we have > p(2) while for p 3 very small we find p(l) < p(2). In this case the heats 
along the two paths from 1 to 2 have a different sign, and hence the higher-occupied state 
cannot be determined without knowing the detailed kinetics ip (and both possibilities can 
indeed be designed). 

If there are some a priori energy levels E(l) < E(2) < ... assigned to the states so that 
the heat functions take the form q(x,y) = E(x) — E(y) + F(x,y) where F accounts for 
the nonequilibrium driving, then the situation where, e.g., p(l) < p(2) is usually called a 
population inversion. We have seen that a necessary condition for this effect to occur is the 
absence of heat-order between the states 1 and 2. 

Of course the fact that the {ip(x, y)} also determine the stationary distribution is rather 
obvious from the mathematical point of view. What is in fact more strange is that at 
detailed balance (and in the neighborhood of it) heat and heat alone plays such a dominant 
role, and determines on its own the stationary occupations. It is then the challenge of 
nonequilibrium physics to identify a complement to heat and entropy for characterizing the 
steady behavior. In other words, to understand exactly what aspect of the kinetics matter. 
Such studies are under way for different aspects of nonequilibrium theory, including linear 
response relations and dynamical fluctuation theory where the concept of activity, traffic or 



frenesy have been used to tag indeed the relevant kinetic features, e.g. in 
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The original Landauer's blowtorch example considers a particle moving over an energy 
barrier, both sides of which are being heated up differently 4| . That somewhat differs from 
our isothermal stochastic framework but we restrict to the latter to summarize Landauer's 
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idea into a concise mathematical statement. Other results, more vaguely related to the 
original concept are also known, e.g., the possibility to achieve an arbitrary stationary 
occupation distribution \i > by adding a potential — V to the heat function, q(x, y) 
q(x, y) + V(x) — V(y) while keeping the kinetics fixed, plays an essential role in the Donsker- 
Varadhan large deviation theory |14j : the extra potential V was also called a "blowtorch" 



in 



IV. LOW-TEMPERATURE ASYMPTOTICS 

To get more insight into how different aspects of the dynamics enter the structure of the 
stationary distribution, we next look into its asymptotics at low temperatures. We apply 



a variant of Freidlin and Wentzell analysis for small noise adapted to continuous-time 
Markov chains. Mathematically there are no new ideas, but the continuous-time extension 
is relevant for physical applications. It adds the life-time of states as another component in 
the stationary occupations complementing the accessibility of states within the embedded 
discrete-time network. A possible frustration between both components then leads to a 
variety of low-temperature patterns. 

We add the assumption that the transition rates k(x,y) = k(x,y;/3) have the zero- 
temperature (logarithmic) limit 

<f)(x,y):= lim \ log k(x, y; 0), x,y e K (8) 

abbreviated as k(x,y) x e^ x,y \ Since by local detailed balance 02]) we know that 
y) — <fi(y, x) = q(x, y) with the heat q(x, y) temperature-independent, the added premise 
is thus that 4 log ip(x, y\ (3) — > 4>(x, y) —q(x, y)/2 has a well defined limit when (3 — > +oo. The 
escape rates have the asymptotics £(x) = ^ y k(x,y) x e _/3r ^^ with T(x) := — max y (fi(x,y) 
specifying the typical life-time of state x as r(x) ~ e^ r ^. It is useful to decompose 
—4>(x,y) =: T(x) + U(x,y) defining U(x,y) > 0. 

Proposition IV. 1. The stationary distribution has the exponential asymptotics 

lim — logp(x) = -max$(i) (9) 



with 



:= T(x) - mm U{%) (10) 



s 



e 



/3-s-+oo 8 

7 !/-->■ (y,z)eT x ^-q 



forU{%) := Z Me r.U{y,z). 

Proof. To find the stationary distribution we apply the Kirchhoff formula We evaluate 
lim — log W(x) = lim — log TT 

7" (y,z)£% 

= -^rd/)-min[/(r,) 

= *(x)-X)r(y) 

The normalization in ([3]) contributes the largest W(y), which ends the proof of formula 
©■ □ 

Other representations are possible and depending on the physical context, they may 
become more natural. As example, for a network made of metastable states well-separated 
by energy barriers, we could write (f>(x, y) = E(x) — A(x, y) where E(x) can be interpreted 
as the energy of state x and A(x,y) as an effective energy barrier between x and y. At 
global detailed balance A(x, y) = A(y, x), and under local detailed balance A(x, y) — A(y, x) 
corresponds to the work of additional non-conservative forces in the transition x — > y. 
Formula (jUJ) can now be written as 

p(x) x ^in-^W-eW] 

where 

Q(x) := min N A(y,z), Q :— mxa[E(x) + Q(x)] 

At global detailed balance (symmetric A), Q(x) becomes a constant determined by the 
minimizing spanning tree and we recover the Boltzmann distribution. 



In the asymptotic regime 8 — > +oo, some transitions are typical whereas the others 
become exponentially damped. Indeed, when the system makes a jump from x then the 
probability to go to a state y asymptotically goes like p(x, y) = k(x, y)/£(x) x e~^ u ^ x,y \ For 
any x there is always at least one other state y such that U(x, y) = — we call these states 
preferred successors of x and we consider the digraph Q D made of all states and directed 
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arcs indicating all preferred successors. Clearly, those transitions which are in Q but do not 
correspond to a directed arc in Q D become suppressed at low temperatures. Note that Q D 
may not be (even weakly) connected and that it may contain both arcs (x,y) and (y,x). 

Let us denote ty(x) : = — max y ty(y), i.e., p(x) x e^*^. By construction, < 
and there is always at least one state x* such that = 0. Adopting the terminology 



of jfj], we call these states dominant: the stationary occupation of the set of all dominant 
states is exponentially close to unity in the limit /3 — > +oo. That resembles the problem 
of stochastic stability but note that we do not have in general a unique and well-defined 
zero temperature dynamics. Dominant states are the analogue of (dominant) ground states 
for equilibrium statistical models, Yet, here we do not minimize the (free) energy; the 
dominance of a state follows from its long life-time (the first term on the right-hand side 
of ( HOP ) and its accessibility from other states (the second term). For a related analysis in 
terms of radius and coradius, see [if]]. 

The easiest situation appears when there is no frustration between both terms: a state 
x* is called absolutely dominant if (i) it has a maximal life-time among all states, T(x*) = 
max y T(y), and (ii) there exists an in-tree T x * C Q D (i.e., a tree which makes the second 
term to vanish). Clearly, if there exists an absolutely dominant state then all dominant 
states are absolutely dominant. 

Let us finish with an important special case. Assume that the digraph Q D is strongly 
connected, i.e., for any two states x, y there exist both paths from x to y and from y to x 
along the directed edges of Q D . In such an "Escherian world" [it]], for every state x there 
exists an in-tree T x C Q D and hence = T(x), i.e., p{x) x exp \fi(T(x) — ma.x y T(y))}. 

In this case the stationary occupations are entirely determined by the life-times alone, the 
least frenetic ones. Informally, that is due to the absence of barriers which makes all states 
'equally accessible from everywhere'. Those states with maximal life-time are then abso- 
lutely dominant. We note that this "Escherian" case need not contradict detailed balance, 
though these notions can only meet under certain degeneracy conditions: Since the for- 
mer implies p(x) k(x,y) x exp[— /3(U(x,y) + max z T(z))], global detailed balance requires 
U(x,y) = U(y,x) and hence (x,y) G Q D whenever (y,x) G Q D . For \K\ > 2 it requires that 
states with multiple preferred successors exist. 

Continuing Example IIIL2| let us assume q x > and p x x 1 (i.e., with essentially 
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temperature-independent activation factors) for all x = 1,...,N. That corresponds to 
4>(x, x + 1) = q x /2, <fi(x, x — 1) = — q x _i/2, and hence T(x) = —q x /2 and U(x, x + 1) = 0, 
U(x,x — 1) = ((fo + q x -x)/2 > 0. This is a simple "Escherian" case with the strongly 
connected digraph Q D = {(x,x + 1) for all x} and the asymptotic stationary occupation 
p(x) x exp(— (3q x /2 + const). The states x minimizing q x over the circle are absolutely 
dominant. 



V. CONCLUSIONS 



We have given bounds on the relative stationary occupations for Markov jump processes 
in terms of the released heat over paths in the Kirchhoff graph. These heat bounds are 
optimal as they either resolve which of the states are more plausible, or it cannot be decided 
at all from heat alone and other (kinetic) aspects of the dynamics essentially matter. That 
has lead to a precisely stated blowtorch theorem. Finally, we have given the exponential 
low-temperature asymptotics of the occupations of states through their life-time and their 
reachability within the network. We expect such a representation in terms of dominant 
states and their excitations to be of help in the theory of strongly nonequilibrium processes 
under low-temperature conditions. 
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